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ABSTRACT 

This study attempts to generate hypotheses concerning 
teacher performance in the classroom. Seventeen teachers were 
videotaped while teaching a lesson. Pupils completed an achievement 
test and a rating scale of these teachers which placed the teacher in 
a high-, medium, or low-effect group. A comparison of the frequency 
and types of questioning and reinforcing behavior betw.een high- and 
low-effect teachers was then made.. The data from this show that a) 
high-effect groups ask more rhetorical questions than the low-effect 
groups; b) high-level questions distinguished groups from one another 
more than low-level questions; c) high--effect groups provide more 
positive verbal reinforcement than low-effect groups; and d) 
frequency of negative reinforcement does not distinguish one group 
from another. When using IQ as an aptitude measure and frequency of 
any teacher behavior as a treatment , resuli^s show that a) more able 
students perform better with low- frequency questions and 
low-frequency positive reinforcement and b) less able students show 
greater achievement with a high frequency of negative reinforcinq 
behavior, (Thirty-six fiqures and 12 tables of data are presented.) 
(BRB) 
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REINFORCING AND QUESTIONING BEHAVIOR OF TEACHERS 
AS A MEASURE OF TEACHER EFFECTS 



PROBLEM -AND OBJECTIVES 

Rosenshine and Furist (1971) have carefully reviewed the more recent and 
fruitful research on teacher effects and have presented eleven variables of 
which nine are specific teacher behaviors which show some promise of fruit- 
fulness. Of these eleven variables, five clearly evidence relationship to 
accepted criteria of effectiveness of teaching, the remaining six variables 
are less clearly related. The eleven variables presented by Rosenshine and 
Furst are: clarity of presentation, variability in presentation, enthusiasm 
of the teacher, task orientation or businesslike manner of the teacher, stud- 
ent opportunity to learn the criterion material, teacher indirectness, teacher 
criticism (negative relationship), use of structuring comments, types of 
questions asked by the teacher, probing activity of the teacher, and level of 
difficulty of instruction. 

It is entirely possible that a partial reason for failure to establish 
relationships of these variables to a criterion of effectiveness may be due 
to lack of sophistication in our research models. Most of the findings re--, 
ported by Rosenshine and Furst were obtained from a model suggested by Fortune 
(1967) based upon Gage's search for a theory of teaching (.Gage, 1963). The 
model provides a viable strategy for studying teacher effects but jnay require 
some judicious modification as it is applied to a particular_ variable under 
study* 

It is suggested that two of the assumptions underlying the research into 
teacher effects need to be examined. First is the assumption of linearity of 
teacher behavior as related to the product, usually identified as achievement. 
Second, the assumption is frequently made that achievement is the criterion 
variable. 

Considering the first assumption, it is not only possible but is probable 
that the product is not linearly related to the process. Though we know that 
reinforcing behavior on the part of the teacher produces increased achievement, 
it is obvious that at some point as increment in reinforcing behavior not 
result in an increment in achievement but probably will result in a decrement. 
It is likely that the relationship is crescent shaped. The same may be said 
for the variable clarity. At .some point, making something more clear may 
result in boring the students to the point that they no longer pay attention 
to the process thereby causing a reduction in achievement. 

The second assumption presents a more complex situation* There is no 
agreement as to what is the criterion variable. More likely we must seek 
multiple criteria variabTes. If achievement were the only or the primary 
criterion, we know of more effective ways of making gains than through class- 
room teaching. While we cannot ignore teaching, we must consider it in rela- 
tion to other criteria. Pupil satisfaction with the lesson may be one of the 
more pertinent variables to be considered. In fact, Gage (1963) lists a hier- 
archy of criteria wherein the first immediate criteria (short range effects on 
upils) are listed as '*pupil»s achievement of current educational objectives" 



and next "pupil's satisfaction with the teacher". Rosenshine and Furst (1971) 
also state unequivocally that ''the most promising results have been obtained 
in studies in which teacher behavior was described using rating scales" 
either observer or pupil. 

This paper describes a study which builds upon the findings cited above, 
exten'ls that research, and considers alternatives to the assumptions cited as 
possibly influencing earlier findings. Findings within this study should add 
to our knowledge of teachi.ng and become the foundation for Gage's theory of 
teaching, thereby influencing t^^acher preparation 'curricula. 

Statement of the Problem . Are pupil achievement and pupil satisfaction 
with the teacher related to the teacher evidenced behavior concerning frequency 
of and type of questions asked and frequency of and type of reinf orceii:ent pro- 
vided? This is the main question. As a subordinate question, does individual 
pupil aptitude influence the effects of the teacher behavior? 

Reinforcement . Jackson (1968, P. 22f f . ) discusses the in^portance of a 
teacher's reinforcement of a pupil's knov/ledge in a concise manner J 

He is being praised, albeit indirectly, for knowing something, 
for having done what the teacher told him to do, for being a 
good listener, a cooperative group member, and so on. The 
teacher* s compliment is intended to entice the student (and 
those tvho are listening) to engage in certain behaviors in the 
future, but not simply in the repeated exposure of the knowledge 
he has just displayed. (Jackson, 1968, p. 2A) 

Berliner (1969, p. 5) states that one of the most obvious behaviors involved 
in competent teaching performance, regardless of subject matter, is the ability 
to reinforce student participation. The definitions used by Berliner in train- 
ing novice teachers in the skill of reinforcement were used in this study. 

Positive reinforcement will be classified in four categories: 

(1) Positive verbal reinforcement— immediately following a pupil response 
the teacher uses words or phrases such as "good", "fine", "nice job". 

(2) Positive qualifie"! reinforcement — though a response is unacceptable^ 
participation is reinforced by such remarks as "That's good, but...", 
"Right, but don't forget...", "You're on the right track". 

(3) Postive post hoc reinforcement — the teacher recalls a previous posi- 
tive contribution by a student or asks for repetition of a point made 
by a student. 

(4) Non-verbal positive reinforcement 

Negative reinforcement will be similarly classified in four categories: 

(5) Negative verbal reinforcement — immediately following a pupil response 
the teacher uses words or phrases such as "That's wrong", "No", 
"That^s not right". 

(6) Negative qualified reinforcement — when a response is unacceptable 
participation is reinforced but the emphasis is on the incorrectness 
by use of remarks such as "That's wrong, but...", "Wrong, you for- 
got...", "You started off wrong", 
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(7) Negative post hoc reinforcement — the teacher recalls a previous 
erroneous contribution by a student with such a remark as "What 
was wrong with John's statement?". 

(8) Non-verbal negative reinforcement 

The above eight categories were the basis for the definition of the 
independent variable, reinforcement. 

Questioning Behavior . Elliott (1970) suggests that thinking, or manipu- 
lating symbols which represent experience, is one of the chief mechanisms of 
learning and development. Teacher questioning strategies are intended to pro- 
mote the development of more complex pupil thinking* As Berliner (1969) 
points out, a "good" classroom question is one that prompts students to use 
ideas rather than just remember them. Questioning behavior then represents an 
important area in teacher behaviort 

While use of the terms higher order and lower order questioning appear 
too general for accurate differentiation between good and poor teaching, more 
specific categories are extremely difficult to categorize without typed trans- 
cripts of lessons. The following categories have been combined from Parson's 
(1968) Teaching for Inquiry, Questioning Strategies and Berliner's (1969) 
discussion of teaching the skill of probing. 

Rhetorical Questions—questions for which the teacher does not expect 
the pupil to respond, used to redirect or refocus the lesson, or 
for which the teacher does not allow an opportunity for the pupil 
to respond. 

Information Questions — -questions calling for facts. 

Leading Questions — questions asked in such a manner that the teacher 
prompts the student or refers back to material that is known by 
the pupil. 

Probing Questions of one of the following categories: 

(1) Clarification. The teacher asks for more information or 
to supply more meanings 

(2) Increasing critical awareness. The teacher requires the 
pupil to justify his response rationally. 

(3) Refocusing. Rather than proceeding deeper into an area 
with a pupil, the response cay call attention to other 
related areaSt 

(4) Redirection! This is a teacher behavior that Involves 
other pupils in the interchange that is taking place. 

To a student other than the one who has just spoken, the 
teacher may say, "Can you add to that?", "v^fhat are your 
views on that?". 

The above seven categories were modified during training of observers and the 
following categories were used to define the variable questioning. 
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(1) Rhetorical Question/Non-Related — questions for which the teacher does 
not expect nor want the pupil to respond, or for which the teacher 
does not allow an opportunity for the pupil to respond, even if there 
is a response. 

(2) Lower Level — questions calling for facts, simple recall from past 
knowledge or from present class discussion. What, where, when 

d - observation idthin/without the class. No interpretation, class 

review of facts and terms. 

(3) Higher Level — questions asked with a clue or questions which involve 
reasoning. New element is added. Students are required to compare, 
judge, evaluate, translate, imply, analyze, expand, or show a rela- 
tionship of cause and effect. 

(^4). Probing Questions — these are follow-ups to a question already an- 
swered. Uhen the teacher has not received the correct answer, he 
probes. He can start by repeating a question posed by a student. 
These involve: 

Ca) Clarification- The teacher asks for more information or to supply 
more meaning. 

(b) Increasing critical awareness-The teacher requires the pupil to 
justify his response rationally. 

(c) Ref ocusing-Rather than proceeding deeper into an area with a 
pupil, the response may call attention to another related araa. 

(d) Redirection- This is a teacher behavior that involves other 
pupils in the interchange that is taking place. To a student 
other than the one who has just spoken, the teacher may say, 
••Can you add to that?". 

Achievement . Ebel (1967) states ••only when the 'content* of education is 
conceived as a set of goals to be attained, rather than as a set of lessons to 
be studied or as a set of class activities to be carried out, is it education- 
ally useful to seek content validity in a test'^. Achievement was measured 
within this study using a criterion referenced post test designed to sample 
the behaviors from previously provided specified objectives. 

Pupil S a tisfaction . Pupils were asked to complete a teacher rating sheet 
for each lesson immediately following the lesson. The rating sheet is brief, 
contains concrete items, and attempts to assess both their satisfaction with 
the lesson and their feeling about the teacher. 

PROCEDURES 

Sample. The sample consisted of 1? teachers in grades 5 and 6 who 
regularly teach science. A secondary sample for a portion of the study dealing 
with aptitude interaction consisted of all of the students in the classes 
taught by these teachers which numbered approximately 300 students. 

Method . Each teacher was asked to teach a twenty-minute lesson based upon 
a specific behavioral objective. During the lesson the teacher was videotaped. 
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Following the lesson the investigator administered a short achievement test and 
a rating scale* Appendices A, B, and C contain the lesson, achievement test, 
and rating scale, respectively. 

Mean achievement scores and ratings were calculated xor each class to 
yield two scores on each teacher. The scores on both measures were trichoto- 
mized to yield nine cells defining high, medium and low tea;cher effects. 

(Table 1 goes about here) 

Each teacher's videotapes were then analyzed bv a panel of )bservers to 
count the frequency of behaviors defined above, questioning and reinforcing. 
A student "t" tect of significance was used to determine whether frequency of 
various teacher behaviors differ between the most effective and least effective 
teachers. 

As a second step, high and low frequency teacher* s individual studBtit *^ 
achievement gains were plotted against an IQ aptitude m:e-asurexo identify 
whether teacher's behavior interacts with aptitude. 

Lesson ^ Mini-lessons published in T each ing Improvem ent Kit prepaired by 
Jason Hillman, John D, McNeil, W. James Popham and Eva Baker and publi>shed by 
Instructional Appraisal Services, 1972, were examined for passible use. A 
lesson on converging and diverging light rays twhs selected -^^and modified. 
Following a pilot use of the lesson in two classes, a background sheet was 
prepared and final refinement of the lesson plan was completed and mimeographed. 
Appendix A contains the lessen. 
/ y " / 

, Instrumentation , Achievement test., A five-item achievement test (se:e 
Appendix B) was included in Ilillman, et. al. (1972) and was used with the pilot 
test lessons. Reliability of the test was established x>n the two pilot classes 
as r = 0,58 (coefficient alpha, Lord and Novick, 1968) with a total of 33 
students. 

Because a pre-post test design was not utilized, a comparable group of 
5th and 6th grade students who did not receive the lesson were administered the 
test to establish that the test measured what was taught in the lesson. Re- 
sults of comparison between the no-lesson and lesson groups shown in Table 2, 
below, support use of the test as a criterion referenced measure. 

(Table 2 goes about here) 

Intercorrelation of the items on the achievement test are shown in Table 
3, below. All correlations were significant at the 0.05 level. 

(Table 3 goes about here) 

Teacher Rating . A rating scale (see Appendix C) was prepared and tested 
on the pilot test classes. The scale, containing 12 items, yielded intercor- 
relations significant at p ^ .05 level for all intercorrelations except item 
4 with items 2, 3, 6 and 10 and item 6 with item 7. See Table 4, below. 

(Table A goes about here) 
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Reliability was calculated by randomly dividing the class in half (randoin- 
ly deleting one member when the class contained an uneven number of children) 
and calc-UlatiTig a.pearson product moment correlation on the split half classes 
where the number of classes equaled 17| r - 0*96. 

Collectioit of Data , Each class was videotaped whi'. j the lesson was being 
taught. A short time before the class was used to help both the students and 
the teacher to become accustomed to the equipment in the classroom. 

The videotapes were then examined by a panel of three observers to count 
the frequency of behaviors specified, questioning and reinforcing. The panel 
spent considerable time training to recognize the various categories of be- 
havior prior to viewing the tapes. Pilot tapes (teachers one and two) were 
used to train. 

Reliability among the observers ranged from 0.9790 to 0.9998 with lowest 
agreement in the category of "Probing questions". A consultant was called in 
to aid in training the panel for recognizing questioning and as a result, the 
categories were modified from those originally planned. 

RESULTS 

TeacTiers wexe assigned to effects cells according to achievement and 
rating. When Teachers 1 and 2 were eliminated as pilot lessons and t.eacher 19 
was omitted hsrause of videotaping problems (camera did not record entire les- 
son, and lesson ran more than twice the 20-minute time period allotted) there 
were 17 teachers to be assigned to effects cells. Tables 5, 6 and 7 reflect 
the data used to assign teachers to high, medium and low effects cells on the 
two dimensions of rating and achievement. Cells 1, 2 and 4 represent "High 
Effects", cells 6, 8 and 9, "Low Effects". 

(Tables 5, 6 and 7 go about here) 

Results will be reported under three topics: questioning behavior, 
reinforcing behavior, and aptitude treatment interaction results. 

Questioning Behavior . The total number of questions asked, and each type 
of question asked, by teachers in "High Effects" and "Low Effects" groups were 
compared. Because this is not an experimental design but a study seeking to 
generate hypotheses for further experimentation, it might be more fruitful to 
report the level of significance obtained rather than prestablish a signifi- 
cance level. No hypotheses were stated and technically no nulls are to be 
rejected. To the extent that a researcher is willing to risk a Type H error^, 
he might wish to consider whether these findings at 0.10 and 0.15 levels of 
significance hold any promise with more statistical power than the given 6 
degrees of freedom. 

Table 8 reports the complete data for total number of questions asked by 
each teacher and compares the high and low effects groups. Because the high 
group's variance was so great and the dGgT:ees of freedom so small, the rather 
substantial difference between means yields significance at only the 0.15 level* 
Table 9, reflecting other categories of questioning behavior yield mixed but 
not entirely dissimilar results. Though not easily interpretable, it is 
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sui^gf^sted that the substantially different variances between high and low 
groups offers some interesting considerations. All variances yield F ratios 
greater than 0.05 level. The low group consistently is homogeneous \^;hile the 
high group definitely is heterogeneous. An explrination which might be offered 
for this phenomena is the suspected non--linear relationship between the inde- 
pendent and dependent variables, particularly with respect to the high effects 
group. Examination of this hypothesis, however, would suggest that any rela- 
tionship between the independent and dependent variable would yield a U-type 
curve or a dish. Quite the contrary result is observed in Figure 9 which 
reflects, if anything, a crescent or inverted U. Alternatively, it can only 
be suggested that the teaching strategies employed are more significant than 
the variable of questioning. Those teachers who produced high effects with 
questioning frequencies similar to the low effects teachers probably had 3 
teaching strategy which included the planned use of questions. Conversely, 
those in the low effects group may not have had such a planned strategy. 

(Tables 8 and 9 go about here) 

The number of questions of each category, plotted against achievement ar.'! 
rating, are shown in figures 1 through 10, Pearson linear correlation co- 
efficients are shown. In a few instances it would appear that the data were 
more likely curvilinear. 

(Figures 1-10 go about here) 

Table 10 reflects the linear relationship of each of three variables, Ques- 
tions, Reinforcements and IQ, individually and collectively, for the 15 
teachers for which there was complete data, /.s expectedy the relationship 
is non-significant even when used in combination. 

(Table 10 goes about here/ 

Reinforcing Behavior . Frequency of teacher evidenced reinforcing behavior 
was compared by total and by category between high effects and low effects 
groups (see Table 11 below). The most promising comparison was in the area cf 
Positive Verbal reinforcement indicating that those teachers who provide fre- 
quent verbal reinforcement are likely to produce most satisfactory result s. 
It appeared that the sum of positive reinforcement less the negative reinforce- 
ments might yield even stronger results. As may be seen from Table 12, this 
comparison yielded a t-value of 2.34, significant at p-CO.lO. 

(Tables 11 and 12 go about here) 

Similar reasoning might be offered concerning reinforcing behavior as v;as 
offered under questioning behavior concerning variance of the high effects 
group vs« the low effects group^ The topic of judicious use of reinforcement 
incorporated within the teacher*s strategy is more likely an explanation of 
differences in accomplishment than frequency of reinforcement. 

The number of reinforcements for each category were plotted against 
achievement to examine the relationship between these variables. Correlation 
coefficients are shown on figures 11 through 20. 

(Figures 11-20 go about here) 
7 



ERIC 



Aptitude-Treatment Interaction , The investigation of learning perf oriricince 
as an interactive function of individual differences of the learners and alter- 
native modes of instruction is generally referred to as Aptitude-Treatment 
Interaction (ATI)(Cohen, 1969). In this investigation, IQ, which was used as 
an aptitude measure, was unavailable for three of the groups (classes). By- 
plotting achievement on the abscissa and IQ on the ordinate, a class may be 
represented by a regression line. Each class is identified with a teacher, 
therefore each line is referred to as Teacher 1 or Teacher 2 and is repre- 
sentative of the treatment, i.e., high frequency questioning teacher, low 
frequency reinforcing teacher, etc. 

In examining interactions between high frequency and low frequency 
teachars, only a limited number of classes offer promise. Teacher 18, for 
example, (see figures 21-3A, below) evidenced a high frequency of questioning 
and a high frequency of positive reinforcing behavior. Figure 35 below re- 
flects the resultant interactions with low frequency teacners numbers 3, 9 and 
10. It would appear that the more able students perform better with a low 
frequency of questions and low frequency of positive reinforcements. 

(Figures 21-35 go about here) 

One of the most dramatically high frequency behavior teachers, number 20, 
evidences no interaction with low frequency questioning and positive rein- 
forcing teachers, but demonstrates considerable interaction with teachers 8 srd 
11 who evidenced low frequency of negative reinforcing behavior. Figure 36 
indicates that less apt students achieve greater with high frequency of nega- 
tive reinforcing behavior than more apt students. 

(Figure 36 goes about here) 

CONCLUSIO NS 

This study represents an attempt to generate hypotheses which might be 
fruitful for investigating experimentally in the area of teacher performance 
in the classroom. It was designed to classify high effects and low effects 
teachers by using a combination of pupil measures — achievement and satisfac- 
tion. Particular performances studied are questioning and reinforcing 
behavior of the teachers. Not being an experimental study, there was no 
specific hypotheses to test and no pre-established probability level cut-off. 
In addition to generating hypotheses about behavior of high group effects and 
low group effects teachers, the study also seeks to identify effects on in- 
dividual students through the examination of the behavior as it interacts with 
individual pupil aptitude. 

Questioning . Lower level questions appeared to distinguish least betwe^i?- 
high and low effects teachers. Perhaps surprisingly, non-related or rhetorical 
questions were significant at the p ,^ 0.15 level which may support a general 
conclusion that structuring or teaching strategy was a confounding variable. 
This appears to be the most parimonious explanation of striking differences in 
the homogeneity of the two groups. The low effects group consistently re- 
flected a low variance whereas the high effects group reflected a high degree 
of heterogeneity or large variance. Probing questions seemed less significant 
than higher level questioning. 
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Reinforcing , Positive verbal reinforcements by the teacher appear to be 
a fruitful area for research. In fact, positive reinforcing behavior reflects 
significance at p<0.10 levels a more significant behavior than any other 
behavior examined. Again, the large variance of the high effects group 
suggests reinforcing used strategically is most promising. 

Aptitude-Treatment Interaction (ATI) . On the basis of only a limited 
number of cases, a tentative area to explore would be the interaction of 
questioning and positive reinforcing with aptitude. There is some evidence 
that more able students perform better with a low frequency of questions and 
low frequency of positive reinf orceinent. Conversely, the evidence tends to 
favor a higher frequency of negative reinforcing behavior for less able 
students. 

Implications for Further Study . Several factors need to be considered if 
future , studies of this nature are planned. First is collection of data on a 
broader range of teachers. Due to the geographical area in which the data 
were collected, many of the teachers were graduates of the same, or similar 
teacher training institutions. It is suggested, but not demonstrable, that 
exposure to similar methods teachers may have caused a similarity of behaviors. 
This may also be partially accounted for in that this geographic region tends 
to be fairly homogeneous in its educational expectations. Only two of the 1.7 
teachers evidenced very high frequency of behaviors studied, most a fairly 
low frequency. There needs to be a broader spectrum of frequencies for valu- . 
able research. 

Secondly, there needs to be an examination of the teaching strategies 
employed and comparisons of teachers utilizing similar strategies. In order 
to account for the large variance in the high effects group, it may be nec- 
essary to reexamine the videotapes for several such considerations. 

A third factor is the instrumentation. Though of adequate validity and 
reliability group use, a more sensitive achievement test is needed to obtain 
individual data and might pick up finer differences across classes. 

Fourthly is the need for more sophisticated multivariate analysis. An 
addendum to this report wiM be prepared to examine non-linear relationships 
between the variables under study and if possible, a canonical analysis using 
both achievement and rating as dependent variables. 

Lastly, it is suggested that greater power is needed to test any such 
hypotheses. A study of considerably larger scope would appear to be in order 
considering more teachers^ more behaviors and possibly such added controls as 
multiple lessons, retention across time, and generalization across teachers. 
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LESSON: LIGHT RAYS 



I, Instructional Objectives 

Given a diagram containing parallel light 
rays, air, and lenses, the student will 
indicate whether the light rays will con- 
verge or diverge by circling the correct 
term. 



II. Materials: 

Glass lenses (Light) 
Charts 

Test + pencils 

III* Development 

a. Introduction - Light vs» Dark 

b. Everything either (1) gives or (2) reflects light 

c. Light rays travel at different speeds 

I. density mediums - air, low density medium 

glass, higher density medium 

2» rays bend as they hit an object 

d. Using charts and lenses explain 

1. converge - br.ing together - con 

2. diverge - spread apart - di 

e. Test - Read directions aloud - time, 15 minutes 

IV. Time: 30 minutes 

V. Evaluation 



-11- 



TEST! LIGHT RAYS 



NAME 



For each diagram decide if the light rays will converge or diverge. If you 
Uiink the light rays will converge, put a circle around the word CON\?ERGE. 
If yxi think the light rays will diverge, put a circle around DIVERGE. 




CONVERGE 
DIVERGE 



CONVERGE 
DIVERGE 



CONVERGE 
DIVERGE 



CONVERGE 
DIVERGE 



CONVERGE 
DIVERGE 



TEACHER^S BEHAVIOR INVENTORY 



Name of Teacher School Date 



Directions 

Listed below are statements which tell how some teachers act. We would 
like you to mark how well each statement describes the way your teacher acts. 

Read each statement. Opposite the statementi circle the word that best 
describes your teacher. If you do not understand the directions, please 
raise your hand and we will help you. 



Mark an answer for each statement. 



My 


teacher: 








1. 


gives directions that are clear and easy to 

VU.lUtlJ.o UdJlLU,. 


Vac 


O^iUc LJ.JUc::o 


t 


2o 


expects too much of us. 


Yes 


Sometimes 


No 


3. 


makes class work exciting. 


Yes 


Sometimes 


No 




uses words which we are able to understand. 


Yes 


Sometimes 


No 


5. 


is a happy teacher. 


Yes 


Sometimes 


No 


6. 


praises us when we do a good job. 


Yes 


Sometimes 


No 


7. 


shames and embarrasses some students. 


Yes 


Sometimes 


No 


8. 


understands us. 


Yes 


Sometimes 


No 


9. 


spends time helping each of us with his or 
her special problem. 


Yes 


Sometimes 


No 


10. 


tries to find things that we are "good at'' 
rather than "poor at". 


Yes 


Sometimes 


No 


11. 


causes us to be afraid to ask questions and 
to answer questions. 


Yes 


Sometimes 


No 


12. 


is friendly to each of us in the class. 


Yes 


Sometimes 


No 



Achievement 
5 ^ 



2 . 

1 



X 

/ 



r = 0.1068 



10 20 30 . 40 50 60 



RHETORICAL QUESTION/NON-RELATED 
FIGURE 1 



Rating 



r = .0.2411 
— ' 

20 5o 



40 



50 
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RHETORICAL QUESTION/NON-RELATED 
FIGURE 2 



Achievement 
5 - 



10 



r = 0.0585 



20 



30 



^0 



50 



-J 

60 



Rating 



30 



20 



10 



LOWER LEVEL QUESTIONS 
FIGURE 3 



X 



X 



r = 0.3423 



10 



20 



30 



^0 



50 



60 



LOWER LEVEL QUESTIONS 
FIGURE 4 



Achievement 

5 



Rating 
30r 



X 

it 

X 
K 



K 



2 ^ 



I 



r '= 0.1553 



-rir i f 

10 15 20 

HIGHER LEVEL QUESTIONS 
FIGURE 5 



20* 



X 



10- 



r = 0.2970 
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10 



15 
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20 



HIGHER LEVEL QUESTIONS 
FIGURE 6 



Achievement 
5 



i 

i 



X 



1 



r = 0.2266 



20 



40 60 

PROBING QUESTIONS 

FIGURE 7 



80 



100 



120 



Rating 
30 
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10 - 



X 



.V 



20 
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r = 0.2128 



40 60 

PROBING QUESTIONS 
FIGURE 8 
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120 



Achievement 
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I 



Rating 
30 



20 



10 
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40 



r = 0.1428 



80 



TOTAL QUESTIONS. 
FIGURE 9 



r = 0.3054 
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120 



160 
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FIGURE 10 
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K X 
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POSITIVE VERBAL REINFORCEMENT 
FIGURE 11 



100 
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r = 0.2431 
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POSITIVE VERBAL REINFORCEMENT 
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FIGURE 12 



Achievement 
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P OSITIVE QUALIFIED REINFORCEMENT 

FIGURE 13 



10 



Rating 



30 r 



20- 
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X 



r = 0.0239 
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POSITIVE QUALIFIED REINFORCEMENT 
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FIGURE 14 
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r = 0.0109 



10 



15 



20 



25 



30 



NEGATIVE VERBAL REINFORCEMENT 
FIGURE 15 
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NEGATIVE VERBAL REINFORCEMENT 
FIGURE 16 
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FIGURE 17 
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FIGURE 18 
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Figure 22 



y=104.25 + 0;27x 



Achievement 
Figure 24 



+3 

c 
o 

•H 
4J 
O 

o 

0) 

u 
c 

(D 
Cr 
•H 
H 
H 

H 



v=100.99 + 



T 



8 



Achievement 
Figure 25 




Achievement 
Figure 26 



•rj 

o 



Hi 




T 



10 



a; 

o 

O 

(D 
O 



0) 
H 



Achievement 
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Figure 29 
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ACHIEVEMENT 
High and Low Frequency Teachers 
Questioning and Positive Reinforcing Behavior 

Figure 35 




T8 Low Preq. 
Til Low Preq, 
High Freq. 



ACHIEVEMENT 
High and Low Prequency Teachers 
Negative Reinforcing Behavior 

Pigure 36 



TABLE 1 

DEFINITION OF TEACHING EFFECTS 

High Average 

Criteria Rating Rating 

High Achievement 1 1 

Average Achievement 1 3 

Low Achievement '3 2 



Notes: 1 
2 
3 



= High effects 
= Low effects 
= Medium effects 
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TABLE 2 

COMPARISON OF GROUPS RECEIVING LESSON 
AND NOT RECEIVING LESSON 

Control Total Pilot 

No Lesson Sample Sample 

Number 90 303 33 

Mean 2.67 3.7A 3.24 

Variance 1.60 2. AO 2.12 

Reliability 0.33 0.77 0.58 

t L 



6.68 I p<.001 



t L 



2 .13 I p < .05 



TABLE 3 
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INTERCORRELATION OF ITEMS ON ACHIEVEMENT TEST 

(N = 303) 



Item 
1 
2 

3 

5 
Sum 



1 

1.0000 
0.2160 
0.5052 
0.2934 
0.4271 
0.6361 



Sum 



1.0000 
0.5752 
0.2602 
0.4807 
0.7105 



1.0000 
0.4045 

0.4268 
0.7937 



1.0000 

0.5042 1.0000 
0.6997 0.7864 



1.0000 
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TABLE 5 
ACHIEVEMENT BY TEACHER 



Teacher 
3 

5 

6 

7 

8 

9 
10 
11 
12 
13 
U 
15 
16 
17 
18 
20 
Total 



Mean 
2.64 
3.76 
4.13 
3.58 
4.00 
3.42 

4.63 
3.87 

3.21 
3.75 

3.74 
4.26 
3.95 

3.38 
3.62 

3.22 
3.69 
3.74 



S.D. 
1.60 
1.68 
1.73 

r.3i 

1.49 
1.41 
0.76 

1.32 

2.07 
1.69 
1.54 
0.81 
1.47 
1.94 
1.68 
1.72 
1.60 
1.55 



■Number of 
Students 

14 

17 

15 

12 

20 

24 

19 
23 

19 
16 
23 
27 
20 
24 
8 

9 

13 

303 



Rank Order 
by Mean 

17 

7 

3 
12 

4 
13 

1 
6 

16 

8 

9 

2 

5 
14 
11 
15 
10 
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Teacher 

3 

A 

5 

6 

7 

8 

9 
10 
11 
12 
13 

14 
15 
16 
17 
18 
20 
Total 



TABLE 6 
RATING BY TEACHER 

Namber of 

Mean S.D. Students 

17.64 4.09 14 

20.69 ^.56 16 

21.12 5.10 16 

15.54 2.14 13 

18.00 2.79 20 

17.21 ^.24 24 
17.05 2.72 19 

22.22 5.23 23 

12.53 0.84 19 
16.69 T.^o 16 
19.45 4.31 22 
13.96 1.78 26 
16.68 2.89 19 
22.83 4.51 24 
16.00 1.16 7 
20.11 3.72 9 

20.54 3.78 13 
18.16 4.59 300 



Rank Order 
by Mean 

9 

4 

3 
15 

8 
10 
11 

2 
17 
12 
7 

16 
13 

1 
14 

6 

5 



TABLE 7 

ASSIGNMENT OF TEACHER TO EFFECTS CELL 



ACHIEVE- 
MENT 



High 



High 

T# Ach.Sc. Rating 



5 
10 



4.13 
3.87 



21.12 
22.22 



RATING 



Medium 
T# Ach.Sc. Rating 



7 

9 



4.00 
4.63 



18.00 
17.05 



Low 

T# Ach.Sc^ 



14 
15 



4.26 
3.95 



Rating 
13,96 
16.68 



Medium 



4 

20 



3.76 
3.69 



20.69 
20.54 



13 



3.74 19.46 



6 3.58 15.54 
12 3.75 16.69 

17 3.62 16.00 



Low 



16 3.38 22.83 3 
18 3.22 20.11 8 



2.64 17.64 
3.42 17.21 



11 3.21 12.53 
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Achievement 
High 

Medium 
Low 



TABLE 8 

NUMBER OF QUESTIONS BY EFFECTS CELL 
Rating 



High 



Medium 



Low 





Quest . 




Que3t , 




Quest. 


5 


85 


7 


32 


14 


93 


10 


45 


9 


62 


15 


123 


4 


107 


13 


86 


6 


43 


20 


218 






I? 


47 










17 


40 


16 


55 


3 


47 


11 


33 


18 


118 


8 


45 







Mean Number Questions 

Variance 

N' 

t 



Cell 1, 2 & 4 
(High Effects) 

91.50 

4571,50 
6 



Cell 6, 8 & 9 
(Low Effects) 

42.50 

28.70 

6 



1.77 p <( 0.15 



TABLE 9 



COMPARISON OF TYPE OF QUESTION BY 







HIGH 


AND LOW 


EFFECTS 










High Effects 


Low 


Effects 




Difference 


Type of 
Question 


Mean 


S.D. 


Mean 


S.D . 


Mean 


Significance 
t Level p <^ 


Rhetorical or 
Non-related 


20.33 


12.11 


10.67 


3.88 


9.66 


1.86 


0.15 


Lower Order 


2A.83 


19.15 


15.33 


4.93 


9.50 


1.18 


0.30 


Higher Order 


9.83 


8.93 


3.33 


1.51 


6.50 


1.76 


0.15 


Probing 


38.50 


. 35.26 


13.17 


4.79 


23.33 


1.61 


0.20 


Total 

Questions 


91.50 


67.62 


42.50 


5.35 


49.00 


1.77 


0.15 
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TABLE 10 



CORREIATION OF ACHIEVEMENT AND RATINGS 
WITH OTHER VARIABLES 
(N = 15 Teachers) 



Independent and 

Control Variables 

Number of Reinforcements 

Number of Questions 

IQ 

Multiple R 



Dependent Variables 



Acliiievement 

- 0a374 
0.2^06 

- 0.2143 
0.3594 



Rating 
0.0764 
0.4144 
0.1093 
0.6379 



TABLE 11 

NUMBER OF REINFOB.CEMENTS BY EFFECTS CELL 



Achievement 
High 

Medium 
Low 



High 



18 



Rating 
Medium 



Low 



T# 


P.'2inf . 


T# 


Reinf . 




Reinf. 


5 


53 


7 


26 


14 


85 


10 


30 


9 




15 


108 




69 


13 


55 


6 


35 


20 


135 






12 


52 










17 


31 


16 


li9 


3 


30 


11 


29 



89 



36 



Mean 

Variance 
N 

t 



Cell 1, 2 & 4 
(High Effects) 

59.50 

1612.83 

6 



Cell 6, 8 & 9 
(Low Effects) 

35.50 

73.10 

6 



1.67 p<^0.20 



TABLE 12 



COMPARISON OF TYPES OF REINFORCEMENT BY HIGH 
AND LOW EFFECTS 



High Effects Low Effects . Difference 

Type of " Significance 

Reinforcement Mean S.D. Mean S.D. Mean t Level p < 

Postive 

Verbal ^9.00 29.30 2^.17 7.17 2^.83 2.02 0.10 
Postive 

Qualified 1.50 2.26 2.17 2.13 -0.67 -0.52 

Negative 

Verbal 4.50 6.86 6.33 7.00 -1.83 -0.45 

Negative 

Qualified 2.50 3.27 2.50 1.76 0.00 

Total 59.50 40.16 35.50 8.55 24.00 1.67 0.20 

Total Positive 
minus 

Total Negative 42.50 22.64 17.50 13.18 25.00 2.34 0.10 



